Search AI Products and News

Bug fixing is a persistent challenge in software development. ByteDance's Doubao large model team has exciting news: they've launched Multi-SWE-bench, the first multi-lingual software engineering (SWE) dataset. This new dataset aims to evaluate and improve the ability of large models to automatically fix code errors. Multi-SWE-bench significantly expands the scope compared to previous single-language datasets. It covers not only Python, but also...

According to foreign media reports, Microsoft's Chief Technology Officer, Kevin Scott, has boldly predicted that by 2030, as much as 95% of programming code will be generated by artificial intelligence. However, he clarified that this doesn't signify the end of human involvement in software engineering. Scott explained that this doesn't mean AI is doing the software engineering work; the authors will still be human. It creates another layer of abstraction, as we transition from 'input masters' (programming languages) to 'prompt masters' (AI coordinators).

OpenAI has released SWE-bench Verified, aiming to more accurately assess AI performance in software engineering tasks and address the limitations of the original SWE-bench, such as overly strict unit tests, ambiguous problem descriptions, and challenging development environment setups. The new benchmark improves assessment consistency and reliability by introducing a containerized Docker environment, significantly enhancing the performance scoring of AI models. GPT-4o solved 33.2% of the samples under the new benchmark, while the best open-source agent framework has...

A new study has found that ChatGPT's accuracy in answering software engineering questions is below fifty percent. The results show that 52% of ChatGPT's answers to software engineering questions are incorrect. While ChatGPT performs better on general questions, 77% of its answers are still overly verbose.